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I.   Introduction 

Research  studies  have  illustrated  the  importance  of  innovation  for 
growth  in  economies  and  in  industries.   On  the  micro  or  firm  level, 
innovation  by  others  has  been  shown  to  be  of  potential  harm  to  the 
non-innovating  firm.   The  relationship,  however,  between  creating  a 
technological  advantage  and  creating  a  competitive  advantage  for  the 
innovating  firm  remains  unclear.   The  difficulties  arising  from  not 
innovating  have  been  well  documented,  but  the  advantages  for  a  firm  that 
has  innovated  have  not  been  empirically  studied. 

The  difficulty  in  undertaking  a  study  of  the  significance  of  a 
technological  advantage  is  determining  if  such  an  advantage  indeed 
exists.   The  purpose  of  this  paper  is  to  test  a  methodology  for  rating 
technological  advantage.   This  study  will  analyze  quality  of  technology 
in  an  industry  that  is  considered  to  be  technology-driven  because  the 
technology  embodied  in  the  products  is  sophisticated  and  rapidly 
changing.   The  industry  is  medical  diagnostic  ultrasound  equipment. 

The  consumer  in  this  industry,  a  physician,  is  highly  educated  and 
sophisticated.   When  purchasing  equipment,  the  physician  participates  in 
a  decision  process  that  is  long  and  involved.   In  an  attempt  to  make  an 
informed  decision  on  an  expensive  and  important  purchase,  the  consumer 
performs  an  information  search,  asks  for  recommendations,  and  compares 
products.   Because  the  industry  is  technology-driven,  a  more  technically 
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advanced  product  should  be  of  greater  value  to  an  informed  medical 
practitioner . 

E.  von  Hippel  (1976)  defines  innovation  improvements  to  scientific 
instruments  to  mean  those  technology  advances  that  improve  the  functional 
utility  of  the  products.   For  ultrasound  equipment,  this  would  translate 
into  increasing  the  diagnostic  information  one  could  receive  from  an 
ultrasound  scan.   A  machine  with  greater  functional  performance  yields 
more  diagnostic  information  and  has,  therefore,  a  technological  advantage. 

The  research  problem  is  that  no  one  has  yet  developed  an  objective 
way  to  rate  functional  performance  in  ultrasound  equipment.   As  will  be 
explained  more  fully  in  Section  III,  comparisons  of  product 
specifications,  clinical  trials,  and  tests  on  phantoms  (mechanical 
simulations  of  human  tissues)  prove  inconclusive.   Some  other  method, 
therefore,  is  needed  to  rate  the  functional  quality  of  ultrasound 
equipment. 

The  purpose  of  this  study  is  to  see  if,  by  surveying  technical 
experts  from  the  manufacturing  concerns,  a  consistent  set  of  ratings  can 
be  developed.   This  paper  is  a  test  of  a  methodology  to  discover  if  one 
can  obtain  a  consistent  rating  of  functional  quality  which  can  substitute 
for  some  objective,  but  as  of  yet  undetermined,  measure. 

Along  with  the  testing  of  a  methodology,  this  paper  makes  a 
preliminary  investigation  into  whether  the  consumer  feels  that  technology 
is  important,  can  differentiate  quality  of  technology,  and,  if  so,  agrees 
with  the  manufacturing  experts  in  rating  quality.   The  same  survey  method 
is  used  for  consumers'  ratings  of  quality.   The  results  raise  several 
interesting  questions  to  analyze  further  in  a  more  rigorous  fashion. 
This  researcher  intends  to  test  the  significance  of  a  technological 
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advantage  by  using  the  quality  ratings  from  this  paper  and  comparing  them 
to  such  factors  as  ease-of-use,  acquisition  cost,  operating  cost, 
reliability,  serviceability,  and  compatibility   in  a  multivariate 
analysis.   The  physician  survey  results  demonstrate  the  need  for  such  a 
study. 

The  purpose  of  the  present  study,  in  summary,  is  to  test  a 
methodology  for  rating  technological  advantage  and  to  get  a  preliminary 
assessment  of  consumer  perceptions  that  are  to  be  tested  in  further 
research.   The  lack  of  research  in  testing  the  significance  of  the 
quality  of  technology  is  discussed  in  the  next  section.   Discussions  of 
ultrasound  physics  and  the  inherent  difficulties  in  objectively  rating 
ultrasound  quality,  the  importance  of  technology  to  the  industry,  and  the 
consumers'  decision  process  follow.   Later  sections  describe  the  surveys 
and  their  results,  with  a  concluding  section  on  questions  for  further 
research. 


-4- 


II.   Literature  Review 

A  review  of  the  literature  on  whether  a  technological  advantage 
provides  a  competitive  advantage  for  the  innovating  firm  actually  covers 
five  fields  of  research  -  economics,  management  of  innovation,  diffusion, 
marketing,  and  strategy.   Although  each  field  discusses  the  effect  of 
technology  on  competition  and  suggests  that  a  technical  advantage  should 
provide  a  competitive  advantage,  little  testing  of  the  actual  premise  has 
occurred.   Inferences,  instead,  are  made  from  research  in  similar  areas. 
This  section  reviews  studies  in  each  of  the  five  areas  and  discusses  the 
theories  and  inferential  studies  to  date. 

Economics 

The  economics  literature  makes  a  strong  case  for  the  benefits  to 
society  of  technological  advance.   Schumpeter  (1934)  described  the 
dynamic  behind  economic  development.   He  felt  that  it  is  not  possible  to 
explain  economic  change  by  previous  economic  conditions  alone.   Economic 
development  arises  from  changes  in  knowledge,  which  lead  to  new  or 
improved  products  and  to  new  processes.   New  products  and  processes  are 
the  results  of  technological  advances,  which,  therefore,  drive  growth  in 
economies,  create  new  industries,  and  alter  competition  within  existing 
industries . 

Fellner  (1971)  in  his  review  of  the  various  methods  of  measuring  the 
benefits  of  technology  advancement  concludes  that  it  is  "the  main  source 
of  the  significant  rise  of  the  standard  of  living  in  Western  economies." 
Rosenberg  (1972)  in  his  study  of  nineteenth  century  innovation  in 
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American  industry  also  concludes  that  technology  change  leads  to  growth. 

Because  of  the  importance  of  innovation  in  economic  growth,  much  of 
the  economic  literature  then  becomes  preoccupied  with  the  effect  public 
policy  might  have  on  innovativeness •   Studies  anlayze  innovation  with  the 
size  of  the  firm,  with  the  concentration  of  the  industry,  and  with  the 
usefulness  of  patents  and  trademarks.    The  proper  level  of  funding  for 
research  and  the  proper  agencies  -  government,  industry,  and  academic  - 

to  perform  the  research  have  been  analyzed  along  with  the  rates  of 

2 
returns  to  be  expected.    Also,  the  height  of  entry  barriers  and  their 

3 
effect  on  innovation  have  been  studied. 

But  what  of  the  effects  of  technology  advancement  on  the  innovating 

firm?   The  same  authors  who  posit  innovation's  benefit  to  society  can 

only  give  ambiguous  responses  to  innovation's  effect  on  the  firm  by 

drawing  on  the  theory  for  the  need  for  patent  and  trademark  protection. 

Companies  are  felt  to  innovate  to  gain  competitive  advantage,  but  the 

size  of  the  advantage  depends  upon  the  length  of  time  for  competitors  to 

respond.   "Most  of  the  innovative  profits  can  be  captured  before 

4 
competitors  can  copy  them."    But  advances  may  not  only  be  copied,  but 

also  leap-frogged  by  further  advances.   "It  is  equally  important  to 

remember  that  progress  is  strongly  promoted  by  a  high  degree  of 

competition."    Competition,  and  therefore  a  rapid  rate  of  progress, 

will  shorten  advantage  times.   The  slower  the  spread  of  knowledge,  or  the 

slower  the  advancement  of  knowledge,  the  greater  the  appropriabil ity  of 

benefit  to  the  innovating  firm. 

Economists,  then,  believe  that  innovation  advances  growth  for  the 

economy  and  should  be  of  competitive  advantage  to  a  firm  as  long  as  the 

innovation  is  not  too  quickly  copied  or  improved  upon.   Since  a  lead  time 
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is  the  only  real  advantage  to  an  innovator,  "research  expenditures  which 

may  generate  great  benefits  to  society  as  a  whole  may  also  generate  very 
small  benefits  -  or  perhaps  no  benefits  at  all  -  to  the  private  firm 
making  such  expenditures." 

Management  of  Innovation 


The  management  of  innovation  literature  deals  with  two  different 
processes:   the  process  of  technical  completion  and  the  process  of 
commercialization.    A  firm  is  assumed  to  have  to  innovate  because 
other  firms  are  innovating.   A  company's  market  share  or  very  existence 

can  be  threatened  by  another  firm's  innovation  so  that  a  firm  is  presumed 

a 
dead  if  it  cannot  generate  new  products  and  processes.    All  firms, 

therefore,  are  assumed  to  need  to  innovate,  but  no  judgement  is  made  on 

the  need  for  technological  improvement  as  opposed  to  duplication.   Is 

technological  advantage  really  leading  to  success  or  is  it  a  combination 

of  other  factors? 

The  process  of  technical  completion  "generates  two  kinds  of  outputs: 

9 
new  and  improved  products,  new  and  improved  processes."    The  success 

or  failure  of  this  process,  then,  is  judged  by  the  successful  completion 

of  a  new  product  or  process.   Studies  on  improving  the  innovation  process 

within  a  firm  use  the  successful  completion  of  specifications    or  the 

,       ,   .   ,  ^    .   11 

judgement  or  managers  as  to  now  tecnnical  groups  are  performing    as 

the  criteria  for  success.   The  process  is  judged,  then,  without  regard  to 

the  competitive  advantages  of  an  innovation. 

The  other  process  in  the  management  of  innovation  literature  is  that 

of  commercialization.   Retrospective  studies  analyze  the  success  or 
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failure  of  new  products  in  the  market  place.   An  example  is  the  SAPPHO 

12 
study.     The  study's  main  conclusion  is  that  success  comes  from 

understanding  the  market.   "Successful  attempts  were  distinguished 

frequently  from  failure  by  greater  attention  to  the  education  of  the 

users,  to  publicity,  to  market  forecasting  and  selling  and  to  the 

13 
understanding  of  user  requirements." 

Understanding  users'  needs,  however,  encompasses  much  more  than  just 

the  functional  performance  and  the  embodied  technology  in  a  piece  of 

equipment.   Product  image,  for  example,  may  be  more  important  than 

product  performance  in  meeting  users'  needs.   Just  because  a  new  product 

or  process  does  well  in  meeting  user  requirements,  one  cannot  infer, 
therefore,  that  it  does  so  because  of  a  technological  advantage. 

Retrospective  studies  of  successful  commercializations  compared 
product  successes  to  product  failures  in  order  to  analyze  significant 
differences.   Quality  of  technology  was  not  a  factor  in  the  analyses  of 
product  successes  but  was  a  factor  in  product  failures.   The  SAPPHO  study 
and  another  analysis  of  commercial  failures  showed  that  some  products 
failed  in  commercialization  because  a  competitor  introduced  a  product 

with  superior  technology.   Inferior  technology  caused  failure  11.5 

14  15 

percent   and  20  percent    of  the  time  for  products  that  did  fail. 

The  management  of  innovation  literature,  therefore,  suggests  that 

innovation  is  important  for  survival  and  that  inferior  technology  may 

lead  to  failure.   The  literature,  however,  does  not  analyze  whether  a 

technological  advantage  leads  to  commercial  success.   Neither  analyzing 

the  successful  completion  of  specifications  nor  analyzing  the  differences 

between  successful  and  unsuccessful  commercialization  allows  any 
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staCements  Co  be  made  about  technological  advantage  and  competitive 
advantage . 

Diffusion  Theory 

Diffusion  studies  have  a  tendency  to  look  more  at  the  adopters  than 
at  the  innovation  in  analyzing  the  rate  of  adoption  of  an  innovation. 
Rogers  (1971),  however,  in  his  review  of  studies  that  do  analyze 
differences  in  attributes  of  innovations  consistently  finds  that  relative 
advantage  is  rated  first  or  second  as  a  determinant  of  the  rate  of 
adoption. 

Relative  advantage  is  the  degree  to  which  an  innovation  is  perceived 
as  better  than  the  practice  that  it  supersedes.     A  point  to  emphasize 
is  that  perceived  advantage  and  not  objective  advantage  is  what  is 
positively  related  to  the  rate  of  adoption. 

Diffusion  studies,  also,  look  at  innovations  more  as  an  idea  or 
practice  than  as  a  specific  product,  e.g.,  solar  heating  rather  than 
Company  XYZ ' s  solar  heating  product.   Industries  or  product-market 
segments,  then,  rather  than  individual  firms  are  analyzed.   Rates  of 
diffusion  of  an  innovation  have  been  found  to  vary  by  the  number  of  firms 
in  an  industry   and  by  the  capacity  and  profitability  of  an 
industry. 

None  of  the  diffusion  studies  explicitly  analyze  technological 
advantage  and  competitive  advantage  (improved  diffusion)  for  the  firm. 
One  could  easily  infer,  however,  that  the  importance  of  relative 
advantage  for  an  industry  holds  for  technological  advantage  and  the 
firm.   Especially  in  a  high-technology  industry,  a  real  technological 
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advantage  should  lead  to  a  real  relative  advantage  and  then  to  a 
perceived  advantage.   A  perceived  relative  advantage  is  positively 
related  to  faster  diffusion,  which  leads  to  greater  market  share  and 
short-term  profits. 

Marketing 

Marketing  does  not  really  address  the  concept  of  a  technological 
advantage  because  customer  value  is  determined  by  evoked  preferences.   To 

improve  the  quality  of  a  product,  a  marketer  must  improve  a  product's 

20      .     .     . 

position  on  a  perceptual  map.    As  with  diffusion  theory,  quality  or 

relative  advantage  is  perceptual  and  not  necessarily  real.   Although 
marketing  theory  envelops  all  products,  the  empirical  work  has  been  done 
with  consumer  products.   The  extension  to  high-technology  products, 
therefore,  can  only  be  surmised. 

Quality,  in  marketing  theory,  is  determined  by  consumers  after  they 
have  experienced  a  product.   By  ascertaining  consumer  preferences  and  by 
performing  factor  anaylses,  the  determinants  of  product  quality  are 
established.   In  a  high-technology  industry,  one  could  easily  assume  that 
improved  technology  should  lead  to  improvements  in  one  or  all  of  the 
factors  of  quality. 

Improved  product  positioning  is  important,  as  Urban  (198A)  has  shown, 
because  success  is  determined  in  a  consumer  market  by  either  being  first 
into  a  market  or  by  coming  in  later  with  a  better-positioned  product. 
Pioneering  brands  are  felt  to  gain  advantages  in  reduced  customer 
uncertainty,  stable  preference  patterns,  lower  production  costs,  and 
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raised  barriers  to  entry.   These  advantages  are  long-term  and  may  accrue 
without  patent  protection  or  long  lags  in  imitation.   To  overcome  the 
advantages  of  being  first  to  a  market,  Urban  showed  that  a  later  entrant 
must  have  a  superior  product;  a  parity  product  will  achieve  less  market 
share  than  a  pioneering  brand. 

A. technological  advantage,  then,  should  be  important  for  two 
reasons.   If  a  firm  can  use  a  technological  advantage  to  create  a  new 
market,  it  will  accrue  the  benefits  of  a  pioneering  brand.   If  a  firm  can 
improve  product  positioning  by  improving  technology,  it  can  garner  market 
share  in  an  established  market.   Although  Che  marketing  literature  does 
not  analyze  the  implications  of  a  technological  advantage  directly,  such 
an  advantage  should  lead  to  a  marketing  competitive  advantage. 

Strategy 

The  strategy  literature  is  just  beginning  to  come  to  grips  with 
innovation  and  its  effect  on  competitive  position.   Horwitch  (1983) 
discusses  the  subsidiary  position  technology  has  played  in  the  corporate 
strategy  literature  but  argues  that  its  role  is  being  elevated.   Porter 
(1983)  also  argues  that  the  study  of  competition  has  been  decoupled  from 
the  study  of  technological  innovation  so  that  one  can  merely  discuss 
conceptual  links.   Corporate  strategy,  therefore,  has  only  focused  on 
technology  portfolios  and  on  timing  of  entry. 

The  strategy  literature  agrees  with  the  economics  literature  in  that 

innovation  can  create,  transform,  or  destroy  industries  and  therefore 

21 
alter  competitive  positions.     Since  technology  can  have  such  a 

substantial  impact  on  a  business,  a  firm  should  maintain  a  portfolio  of 
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22 
technical  capabilities.     The  technology  portfolio,  however,  is  still 

analyzed  separately  from  a  business  portfolio. 

Strategists  maintain,  then,  that  technology  development  must  be 

linked  to  the  other  organizational  areas  within  a  firm,  e.g.,  marketing 

23 
and  manufacturing.  ■   Once  a  firm,  however,  has  developed  a  portfolio 

of  technical  capabilities  and  has  linkages  throughout  the  organization, 

it  must  revert  back  to  the  generic  competitive  strategies  open  to  it 

before . 

Porter  (1980)  defines  three  generic  strategic  approaches  a  firm  can 

take : 

1.  overall  cost  leadership 

2.  differentiation 

3.  focus 

Since  the  focus  approach  entails  using  either  of  the  first  two  approaches 
on  a  select  market  segment,  there  are  really  only  two  fundamentally 
different  strategies.   Technological  innovation  can  be  used,  then,  to 
either  improve  one's  cost  position  or  to  differentiate.   Differentiation 

would  entail  using  a  technology  to  create  new  products  or  to  serve  new 

24 
customer  groups. 

The  final  strategic  decision  left  to  a  firm  that  is  implementing  a 

generic  strategy  with  new  technology  is  whether  to  be  offensive  or 

25 
defensive.     An  offensive  strategy  is  to  be  first  while  a  defensive 

strategy  is  to  enter  later.   A  later  entrant  can  lag  behind,  match,  or 

improve  on  the  leader's  product. 

Several  studies  have  looked  at  the  significance  of  entry  timing. 

Freeman's  (1982)  review  of  surveys  analyzing  industrial  R&D  in  several 

countries  concludes  that  most  R&D  is  "defensive"  rather  than  offensive. 
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The  SAPPHO  study,  moreover,  pointed  out  that  in  medical  instruments  the 
later  entrants  performed  better  in  commercializing  their  products.   The 
question  still  remains,  however,  of  whether  the  later  entrants  were 
competing  with  i-proved  technology  or  merely  copied  technology? 

No  studies  address  this  question  directly,  but  one  can  infer  from 
other  studies.   The  marketing  studies,  as  shown,  would  suggest  that  a 
defensive  strategy  still  requires  an  improved  product.   A  corroboration 
of  that  idea  would  be  Porter's  (1979)  study  of  large  and  small  firms.   In 
medical  goods,  smaller  firms  were  found  to  have  rates  of  return  much 
higher  than  the  larger  firms.   One  could  hypothesize  that  since  a  smaller 
firm  cannot  match  advertising,  promotional,  and  sales  expenditures  with  a 
larger  firm,  nor  compete  on  price  because  of  cost  disadvantages  due  to 
scale;  that  the  smaller  firms  must  be  competing  with  improved  products. 
In  a  high-technology  industry  an  improved  product  is  probably  due  to 
improved  technology,  so  a  technological  advantage  does  provide  a 
competitive  advantage. 

The  corporate  strategy  literature,  in  summary,  has  not  considered 
explicitly  whether  a  technical  advantage  provides  a  competitive  one.   The 
preliminary  conceptual  work  states  that  a  firm  must  have  a  range  of 
technical  capabilities  and  organizational  linkages.   The  generic 
strategies  do  not  change  with  innovation,  but  timing  of  entry  may 
matter.   In  several  empirical  studies,  later  entrants  were  found  to 
perform  better;  the  reason  for  the  better  performance,  however,  is  still 
unknown. 

Although  there  are  no  empirical  studies  to  substantiate  the  reasons 
for  better  performance.  Porter  claims  that  technology  is  the  driving 
force.   "In  industries  where  technological  change  is  rapid  or  the  level 
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of  technological  sophistication  is  high,  the  technological  dimensions  of 

competitive  strategy  can  be  the  primary  source  of  competitive  advantage 

26 
in  the  generic  strategy  being  followed  by  the  firm.'"" 


Summary 

The  five  fields  of  research  just  reviewed  all  concur  that  innovation 
is  important  for  a  firm  to  consider.   Existing  firms  may  be  seriously 
affected  by  another  firm's  technological  advantage,  and  firms  should 
benefit  from  innovation.   Although  the  failure  side  is  well  documented, 
the  benefit  side  is  not.   Economists  and  diffusion  theorists  believe  a 
technological  advantage  provides  a  short-lived  competitive  advantage 
while  marketers  and  innovation  management  theorists  believe  that  it  has 
long-term  affects.   Strategists  believe  that  a  technological  advantage 
can  be  the  most  important  competitive  advantage.   The  above  statements 
are  suppositions,  however,  with  little  empirical  work  to  substantiate 
them. 
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III.   Ultrasound  Physics 

Ultrasound  refers  to  the  generation  of  sound  waves  whose  frequencies 
are  above  20,000  Hertz.   In  medical  diagnostic  ultrasound  imaging,  sound 
waves  are  used  to  produce  images  of  the  body.   The  technique  was  first 
used  in  1943  in  an  attempt  to  map  the  brain.   The  technique  was  borrowed 
from  the  military's  use  of  SONAR,  developed  in  World  War  I,  and  from 
industry's  use  of  ultrasound  to  detect  metal  flaws,  developed  in  the 

thirties.    By  1963  the  first  commercially  produced  diagnostic 

2 
ultrasound  units  were  available. 

Ultrasound  images  are  used  by  physicians  as  an  aid  in  establishing 

diagnoses.   Ultrasound  can  provide  clinically  useful  images  of  most  parts 

3 
of  the  body.    To  create  an  image,  ultrasound  uses  reflected  sound 

waves  as  the  means  of  visualizing  anatomic  structure.   Soft  tissues  have 

varying  acoustic  characteristics  so  that  by  measuring  the  changes  in 

speed,  attenuation,  and  scatter  of  the  echo,  one  can  form  a  mapping  of 

the  various  tissues.   Diagnostic  ultrasound  images  are  used  to  provide 

information  on  the  location  and  size  of  organs  rather  than  on  the 

physiologic  functioning  of  those  organs.   The  information  provided  to  a 

physician  is  a  cross-sectional  display  of  anatomic  images.   To  provide 

more  diagnostic  information,  therefore,  an  ultrasound  scan  must  provide  a 

better  image. 

Pratt  (1978)  considered  image  quality  to  be  composed  of  two  parts: 

image  fidelity  and  image  intelligibility.   Image  fidelity  is  defined  as 

the  difference  in  a  processed  image  from  that  of  some  standard  image;  the 

closer  the  processed  image  is  to  the  standard,  the  higher  the  fidelity. 

Image  intelligibility  is  the  ability  of  a  person  or  a  machine  to  extract 
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relevant  infonnation  from  an  image;  the  more  intelligible  an  image,  the 
easier  one  can  extract  information. 

To  improve  functional  capability  in  an  ultrasound  machine,  an 
engineer  must  improve  the  image  intelligibility  of  the  final  output. 
Because  the  human  visual  system  is  so  poorly  understood,  formulating  an 
intelligibility  measure  based  on  a  perceptual  model  is  not  presently 

possible.   The  most  common  and  most  reliable  judgement  of  image  quality, 

4 
at  this  time,  is  subjective  rating  by  human  observers. 

Although  human  judgement  is  considered  the  best  rating  of  image 
quality,  other  methods  that  might  correlate  well  with  the  subjective 
testing  have  been  tried  but  have  not  yet  been  successful.   Such  methods 
have  included  fidelity  testing,  testing  on  phantoms,  clinical  trials,  and 
measurement  of  individual  parameters  of  technical  performance. 

The  difficulty  in  measuring  image  fidelity  is  that  at  present  there 
is  no  official  standard  against  which  to  measure  performance.    The 
relationship  of  image  fidelity,  moreover,  to  diagnostic  utility  is 
currently  moot.   An  example  in  current  debate  is  the  ability  to  image 
eyelid  hairs  on  a  fetus  in  utero.   What  relevant  information  is  gained? 

In  an  attempt  to  establish  some  standards,  phantoms  (mechanical 
representations  of  tissues)  have  been  used  to  test  fidelity.   Phantoms, 
however,  are  static  while  tissues  move.   Phantoms,  therefore,  do  not  test 
realistic  images  and  are  only  used  to  assess  depth  calibration  and 
electromechanical  alignment. 

Clinical  trials  are  not  definitive  and  take  too  much  time.   A 
clinical  trial  would  test  several  machines  on  the  same  patients.   The 
same  machine,  however,  can  give  a  good  image  of  an  organ  on  one  patient 
and  not  on  another  patient.   "The  favorite  explanation  for  this,  at  the 
moment,  is  that  the  image  is  affected  by  the  organization  of  fat  in  the 


-16- 

patient."   Clinical  trials,  therefore,  need  to  test  many  patients. 
Besides  not  being  able  to  test  all  the  various  types  of  equipment,  a 
clinical  trial  to  compare  products  takes  a  long  time.   The  rapid 
technological  advances  in  ultrasound  technology,  however,  have  caused 
obsolescence  of  equipment,  thereby  rendering  clinical  trials  on  that 
equipment  out  of  date  before  the  reports  are  published. 

Several  difficulties  arise  in  measuring  individual  parameters  of 
technical  performance.  The  main  difficulties  are  judging  resolution 
trade-offs  and  judging  unspecified  design  options. 

To  improve  the  image  of  any  specific  organ,  an  engineer  must  increase 
the  ratio  of  image  signal  to  "noise."  Ultrasound  image  signals,  however, 
carry  a  relatively  high  degree  of  noise.   Noise  comes  from  two  main 

sources.   Ultrasound  does  not  travel  well  through  gas  or  bone  and  is 

g 
therefore  of  little  use  in  imaging  structures  behind  them.    Another 

problem  is  that  tissue  is  not  static.   Tissue  motions  cause  variability 

9 
in  attenuation  and  absorption,  refraction,  and  back  scatter. 

To  improve  resolution,  one  must  trade  off  improvements  on  five  types 

of  resolution  -  lateral,  radial,  temporal,  spatial,  and  contrast. 

The  trade-offs  are  between  aperture  size,  bandwidths,  movement  detection, 

location,  and  penetration.   Improving  the  resolution  in  imaging  one  organ 

may  impair  the  resolution  in  trying  to  image  another  organ.   A  designer, 

therefore,  must  set  a  resolution  mix  as  to  which  organs  or  types  of  scans 

the  machine  will  image  better.   Some  rating  scheme  would  have  to  be 

determined  which  could  compare  overall  machine  quality  by  its  ability  to 

improve  resolution  on  a  number  of  specific  organs.   A  rating  matrix  has 

not  yet  been  determined  that  can  compare  instruments  having  different 

resolution  mixes. 
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The  unspecified  design  options  cannot  be  judged  because  they  are  not 
explicit  and  because  no  one  has  yet  determined  which  methods  are  better. 
Examples  are  quantization  options  for  analog  to  digital  conversion  and 
interpolation  methods  because  of  undersampling  of  the  image. 

Studies  that  have  measured  individual  parameters  of  technical 
performance,  which  are  open  to  testing,  have  shown  a  very  wide  variation 
in  the  magnitude  of  some  parameters  among  manufacturers.     The  problem 
still  remains  that  no  one  has  yet  determined  which  of  those  parameters 
that  are  measurable  lead  to  improved  image  quality. 

The  use  of  diagnostic  ultrasound  is  an  accepted  clinical  technique. 
Diagnostic  information  comes  from  ultrasound's  creation  of  anatomic 
images-.   To  improve  clinical  utility,  one  must  improve  the  image  quality 
of  ultrasound.   The  state  of  the  art  in  judging  image  quality,  however, 
relies  on  the  subjective  evaluation  of  human  judgement.   No  one  has  yet 
determined  some  other  measures  to  test  for  ultrasound  image  quality. 
This  paper,  then,  will  try  to  determine  if  there  exists  a  group  of  people 
who  agree  in  their  judgements  of  image  quality  and  who  consider  the 
various  machines  to  actually  differ  in  their  level  of  quality. 
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IV.   The  Industry 


Although  the  levels  of  image  quality  from  ultrasound  units  may  be 
difficult  to  compare  objectively,  the  importance  of  image  quality  is 
beyond  dispute.   Image  quality  has  improved  dramatically  over  the  last 
several  years,  which  has  led  to  improved  clinical  utility.    Because 

the  advances  in  technology  were  to  improve  image  quality,  technology  has 

2 
been  considered  the  most  important  factor  in  industry  growth. 

Advancing  product  technology  and  improving  equipment  performance  is 

.  .  .3 

considered  the  main  form  of  competition  among  suppliers.    Image 

quality,  for  the  buyers  moreover,  is  considered  the  number  one  purchasing 

4 
criterion. 

Advances  in  the  state-of-the-art  have  come  mostly  from  small, 
start-up  companies.    This  competition  of  improving  technology  has  led 
to  the  continued  fragmentation  of  the  ultrasound  market.   As  new 
companies  have  entered,  the  industry  has  grown  more  fragmented.    Over 
fifty  companies  now  compete  in  diagnostic  ultrasound,  with  the  top  five 
companies  holding  less  than  50  percent  of  the  market  in  1980.    More 
new  companies  are  expected  to  enter. 

Advances  in  the  state-of-the-art  have  come  quickly.   Obsolescence  of 
equipment  by  improved  technology  happens  so  quickly  that  the  industry  has 

a  cycle  time  for  replacement  of  a  generation  of  scanners  of  only  one  or 

9,  10 
two  years. 

Image  quality  is  considered  to  vary  widely  among  the  manufacturers, 

with  only  those  keeping  up  with  the  state-of-the-art  able  to  maintain  a 

firm  competitive  position.     R&D  expenditures  among  competing  firms 

12 
are  high,  often  averaging  20  percent  of  sales.     This  drive  to 
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constantly  improve  Che  technology  is  expected  to  continue. 

The  present  images  from  ultrasound  scans  are  still  difficult  to 

create  and  to  interpret.     Users  continue  to  seek  better  image 

14       .   .  ... 

quality.     To  gain  increased  diagnostic  information  from  ultrasound 

Scans,  however,  manufacturers  are  trying  two  tacks:   improving  the  images 

and  creating  computer  analyses  of  the  images.   Most  of  the  foreseable 

advances  in  technology  that  will  improve  ultrasound's  diagnostic 

accuracy,  however,  will  come  in  improving  image  quality. 

"The  flow  of  novel  developments  continues  today,  making  diagnostic 

ultrasound  one  of  the  most  technologically-sensitive  industries  in  the 

world."     Nine  studies    of  the  ultrasound  industry  all  concur  that 

the  industry  is  technology  driven,  that  competition  rests  on  improving 

image  quality,  and  that  i-mage  quality  is  the  main  purchasing  criterion. 
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V.   Selection  Process 

The  selection  of  ultrasound  equipment  is  a  complex  process.    The 
number  of  people  involved  in  the  selection  and  the  length  of  time  needed 
to  evaluate  equipment  ensure  a  serious,  thoughtful  investigation  of 

equipment  performance  as  well  as  the  many  other  criteria  considered  - 

...    2 
ease-of-use,  cost,  reliability,  serviceability,  and  compatibilLty . 

Because  hospital  radiology  departments  have  been  the  main  purchasers  of 

3 
ultrasound  equipment,   this  section  will  describe  a  typical  hospital's 

evaluation  process. 

The  performance  evaluation  of  ultrasound  imaging  equipment  is  usually 
contemporaneous  with  or  lags  the  capital  appropriation  process.   The 
appropriate  personnel  in  the  hospital,  therefore,  are  aware  of  the 
intended  purchase.   Along  with  the  radiology  ultrasound  specialist,  the 
radiology  department  head  and  other  specialists  will  decide  on  the 
applications  the  unit  must  perform.   Once  the  application  mix  is 
determined,  the  modality  type  can  be  selected. 

A  search  then  ensues  for  the  products  that  are  available  in  the 
selected  modality,  with  some  preliminary  screening  as  to  which  products 
to  investigate  further.   Trade  shows,  medical  journals,  and  peer 
recommendations  are  the  main  sources  of  preliminary  information. 
Prospective  buyers  can  try  the  equipment  at  the  trade  shows  or  at  another 
hospital  that  has  a  unit. 

Once  salespeople  are  alerted  that  a  radiologist  is  interested  in 
purchasing  some  unit,  the  evaluation  process  will  still  take  another  six 
to  nine  months.  '    During  this  time,  manufacturers  are  asked  to  bring 
equipment  to  the  hospital  for  comparison  trials.   Some  hospitals  will 
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request  that  a  unit  be  left  on  loan  for  a  week  to  a  month  for  even  more 
clinical  evaluation.   At  this  time,  the  ultrasound  technicians  will  also 
get  involved  in  the  selection  process  since  they  will  perform  the  trial 
scans  and  will  be  asked  for  recommendations. 

The  ordering  process,  then,  is  both  lengthy  and  complex.   The 
purchaser  tries  for  some  breadth  and  then  depth  in  evaluating  equipment. 
After  an  initial  search  as  to  what  equipment  is  available,  a  number  of 
instruments  are  selected  for  clinical  trials  and  comparisons.   Several 
people  are  involved  in  the  decision  process,  which  is  actuated  over  a 
long  time  period.   The  decision,  therefore,  is  an  informed  one  among 
professional  people. 
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VI.   Research  Method 

Because  so  much  of  the  technological  development  within  the 
ultrasound  imaging  industry  is  aimed  at  improving  diagnostic  utility,  a 
technological  advantage  is  assumed  when  one  machine  can  give  more 
diagnostic  information  than  another.   For  diagnostic  ultrasound,  this 
assumption  translates  into  comparing  image  quality.   An  ultrasound 
machine  that  has  a  better  image  gives  more  diagnostic  information  and 
has,  therefore,  a  technological  advantage.   Ultrasound  experts  considered 
this  line  of  reasoning  to  be  acceptable. 

To  investigate  whether  there  exists  a  difference  in  the  quality  of 
the  technology  among  the  various  ultrasound  products,  we  surveyed 

technical  experts  from  ten  ultrasound  companies.   These  ten  companies 

2 
represented  about  75  percent  of  the  U.S.  market  in  1980.    Since  most 

of  the  companies  are  organized  by  field  of  application,  e.g.,  radiology, 

cardiology,  obstetrics,  technical  experts  in  each  field  were  asked  to 

rate  equipment.   Eighteen  respondents  answered  the  survey. 

Table  I 

Modality  and  Application  Combinations  Used  in  the  Survey 
MODALITY  APPLICATION         NUMBER  OF  EXPERTS 


Mechanical  Sector  -  Radiology  8 

Mechanical  Sector  -  Cardiology  10 

Phased  Array  -  Radiology  7 

Phased  Array  -  Cardiology  9 

B-scan  -  Radiology  9 

Linear  Array  -  Obstetrics  7 
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The  survey  was  conducted  by  phone  and  there  were  no  non-respondents. 
The  survey  consisted  of  rating  each  product  on  a  scale  of  1  to  10  as  to 
image  quality  and  avoiding  tie  scores.   Products  were  listed 
alphabetically  by  manufacturer's  name  and  according  to  modality  and  broad 
field  of  application.   A  technical  expert  within  radiology,  for  example, 
rated  mechanical  sectors,  phased  arrays,  and  B-scanners  used  by 
radiologists.   The  survey  asked  about  equipment  in  only  the  three  largest 
fields  of  application. 

For  each  of  the  six  different  combinations  of  modalities  and 
applications  that  were  examined,  a  high  proportion  of  respondents  worked 
for  companies  that  sold  equipment  of  that  modality  and  application  type. 
To  remove  a  potential  bias,  the  experts  were  not  allowed  to  rate  their  own 
companies'  products.   The  products  also  had  to  have  been  on  the  market  for 
at  least  one  year  so  that  everyone  would  have  had  time  to  analyze  a 
competitor's  unit  if  it  were  desired. 

To  analyze  the  degree  of  consistency  among  the  raters  and  the  level  of 
significance  in  the  difference  between  products,  we  used  nonparametric 
procedures.   The  ratings  were  transformed  into  rankings  and  then  tested 
for  consistency.   Although  Kendall's  coefficient  of  concordance  is  often 
used  to  test  k  rankings  of  n  objects,  the  data  were  not  complete  nor 

symmetrical.   The  Kruskal-Wallis  test  is  the  most  efficient  of  the 

3 

nonparametric  tests  for  k  independent  samples  of  different  sizes,   and 

so  was  used  to  test  for  consistency  of  rankings  and  for  difference  in 
products . 

To  shed  some  preliminary  light  on  the  importance  of  a  technological 
advantage  as  to  market  success,  the  same"  survey  was  administered  to 
radiology  departments  in  45  hospitals  and  private  practices.   Survey  data 
were  collected  by  two  methods.   About  half  of  the  respondents  were 
contacted  by  phone  after  being  selected  at  random  from  the  American 
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Hospital  Association  Guide  -  1983  edition.   Only  New  England  hospitals 
were  contacted  because  of  budget  constraints.   The  other  half  returned 
surveys  they  had  received  at  the  1984  Harvard  Ultrasound  Seminar.   The 
phone  survey  elicited  a  response  rate  of  about  50  percent,  while  the 
seminar  survey  had  a  response  rate  of  about  10  percent.   Five  attendees  of 
the  seminar  who  did  not  return  the  survey  were  called  and  asked  why  they 
did  not.   The  responses  were  consistent  in  that  the  individuals  felt  that 
they  did  not  know  enough  about  the  equipment  to  give  valid  answers.   The 
response  bias,  therefore,  is  probably  toward  individuals  who  thought  that 
they  knew  about  ultrasound  equipment. 

In  addition  to  performing  the  same  rating  scheme  as  the  manufacturers, 
the  radiology  department  respondents  were  asked  to  give  some  background 
information.   Of  the  respondents,  58  percent  were  radiologists  and  42 
percent  were  ultrasound  technicians.   Further  background  information  is 
shown  in  Table  II. 

Table  II 

Background  Information  on  the  Hospital  Respondents 


Region 

New  England 

55% 

All  Others 

45% 

Position 

Radiologist 

58% 

Technician 

42% 

Hospital  Size 

Large  (?400  beds) 

27% 

Medium 

30% 

Small  (^200  beds) 

43% 

Time  of  Last  Purchase 

Less  than  a  year 

68% 

More  than  a  year 

.32% 
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As  can  be  seen  from  Table  II,  the  hospital  survey  data  are  biased 
toward  the  New  England  Region.   The  data  are  also  biased,  however,  toward 
people  who  were  actively  comparing  products  and  who  thought  that  they 
knew  something  about  the  equipment.   Although  the  data  are  not  of 
sufficient  number  to  draw  any  conclusions,  we  feel  that  they  can  still 
give  a  proper  indication  of  where  to  pursue  further  investigation  by 
raising  some  interesting  questions. 
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VII.   Results 
Awareness 

The  application  specialists  from  the  manufacturing  concerns  were 
highly  cognizant  of  their  competitors'  products.   When  answering  the 
survey,  the  application  specialists  were  able  to  make  a  judgement  on  the 
image  quality  of  their  competitors'  products  in  almost  every  case.   In 
striking  contrast,  the  hospital  respondents  had  little  knowledge  that 
many  products  existed,  much  less  awareness  of  the  image  qualities.   Many 
hospital  respondents,  in  fact,  requested  extra  copies  of  the  survey 
because  they  had  never  seen  a  listing  of  all  the  manufacturers  who  sold 
ultrasound  products  in  the  United  States,  even  though  most  of  them  were 
actively  seeking  such  information. 

In  order  to  quantify  levels  of  awareness,  the  ratio  of  the  number  of 
products  that  were  rated  to  the  total  number  of  products  was  calculated 
for  each  type  of  product.   Respondents  from  the  45  hospital  radiology 
departments  were  asked  to  consider  only  equipment  relevant  to  their 
practices  -  mechanical  sectors,  phased  arrays,  and  B-scans  for  general 
radiology  applications.   Because  of  this  restriction,  hospital 
respondents  rated  fewer  types  of  equipment  than  manufacturers.   Awareness 
proportions  for  manufacturers  and.  customers  are  shown  in  Tables  III  and 
IV,  respectively. 

The  argument  could  be  made  that  only  those  hospitals  actively 
purchasing  equipment  should  be  aware  of  the  image  quality  of  the 
available  machines.   A  hospital  department  that  has  not  purchsed 
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Table  III 


Manufacturers'  Awareness 


Type  of  Equipment  Proportion  of  Equipment  Rated  (%) 


Phased  Array-Cardiology  100% 
Phased  Array-Radiology  95 

Mechanical  Sector-Radiology  91 

Mechanical  Sector-Cardiology  90 

Linear  Array-Obstetrics  86 

B-scan-Radiology  81 


Table  IV 


Users'  Awareness 


Type  of  Equipment  Proportion  of  Equipment  Rated  (%) 


Mechanical  Sector-Radiology  54% 

Phased  Array-Radiology  29 

B-scan-Radiology  27 
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equipment  for  some  time  should  not  be  expected  to  stay  abreast  of  all  the 
latest  improvements.   The  data,  however,  fail  to  support  this  contention 
(Table  Va). 

Awareness  levels  of  equipment  image  quality  were  further  analyzed  as 
functions  of  the  professional  positions  of  the  respondents  and  as 
functions  of  the  sizes  of  the  hospitals  in  which  the  respondents  worked. 
Sonographers  were  more  aware  than  radiologists  of  equipment  differences 
(Table  Vb).   This  finding  is  consistent  with  the  lore  of  the  ultrasound 
industry  as  expressed  by  several  salespeople.   Further  discussion  of  this 
knowledge  difference  and  the  sonographers'  role  in  the  purchasing 
decision  process  have  been  the  subjects  of  recent  studies.    The  size 
of  the  hospital,  however,  did  not  have  any  effect  on  the  degree  of 
awareness  of  its  staff. 

—   To  test  further  the  manufacturers'  awareness  by  product  subgroup, 
correlation  analyses  were  performed  between  level  of  awareness  and 
several  factors:   the  number  of  products,  the  number  of  raters,  and  the 
number  of  raters  who  sold  the  specific  type  of  product  in  each  subgroup. 
The  hypotheses  were: 

1)  the  more  products  to  be  rated,  the  greater  the  likelihood  of 
missing  judgements; 

2)  the  more  judges  rating  products,  the  greater  the  likelihood  of 
missing  judgements; 

3)  the  greater  the  proportion  of  judges  who  sold  products  in  the 
specific  product-application  to  be  judged,  the  lower  the 
likelihood  of  missing  judgements. 

None  of  these  factors  correlate  significantly  with  awareness  (Table  VI). 
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Table  Va 


Difference  in  Levels  of  Awareness  by  User  Subgroups 


Subgroups 


Proportion  of  Equipment  Rated 


Hospital  staff  making  purchase 

within  past  year 
Hospital  staff  making  earlier  or 

no  purchase 


43% 
39% 


Z  =  0.99;  NS 


Table  Vb 


Difference  in  Levels  of  Awareness  by  User  Subgroups 


Subgroup 


Proportion  of  Equipment  Rated 


Radiologists 
Sonographers 


36% 

51% 


Z  =  3.94;  p  =  0.01 


Table  VI 


Manufacturers'  Awareness  as  a  Function  of  Several  Factors 


Factor 


Spearman  Rank  Correlation  Coefficient 


Number  of  products 
Number  of  raters 
Number  of  sellers 
Newness  of  modality 

*  o<.=  0.01 


0.59 
0.11 
0.16 
0.99* 
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What  was  significantly  correlated  to  awareness  was  the  newness  of  the 
modality.   The  newer  modalities  are  the  faster  growing  segments. 
Manufacturers  seem  inclined  to  emphasize  analysis  of  competing  equipment 
at  the  leading  edge  of  the  technology  and  do  not  spend  as  much  time 
considering  the  more  mature  modalities. 

A  test  of  this  hypothesis  would  differentiate  the  degree  of  attention 

expended  by  manufacturers  in  analyzing  the  older  and  newer  technologies. 

2 
One  test  would  rank  the  products  in  order  of  their  market  shares   and 

split  the  rankings  into  the  four  leaders  and  the  remainder  within  each 

modality.   A  constant  degree  of  attention  would  be  demonstrated  by  a 

constant  level  of  awareness  between  the  leading  four  products  and  the 

remainder  in  each  category.   This  constant  level  of  awareness  is  true  for 

the  newer  modalities  (Table  VII).   In  the  newer  modalities,  raters  were 

cognizant  of  the  products  of  all  their  competitors.   For  the  older 

modalities,  however,  raters'  awareness  of  the  leading  sellers  was 

significantly  higher  than  of  the  remaining  products.   This  finding  would 

lead  one  again  to  conclude  that  manufacturers  limit  their  analyses  of 

older  technologies. 

Manufacturers,  in  summary,  have  a  high  level  of  awareness  of  the 

image  quality  of  their  competitors'  products,  although  they  appear  to 

emphasize  products  in  the  newer  modalities.   Hospital  respondents,  on  the 

other  hand,  had  much  less  knowledge  of  even  the  existence  of  all  the 

manufacturers  let  alone  the  image  qualities  of  their  products. 
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Table  VII 


Manufacturers'  Awareness  of  Products  with  Leading  Market  Shares 


Type  of  Equipment  Market  Share  Position 


Leaders         Others 


B-scan-Radiology  97% 

Linear  Array-Obstetrics  100 

Mechanical  Sector-Abdomen  100 

Mechanical  Sector-Cardiac  93 

Phased  Array-Abdomen  95 

Phased  Array-Cardiac  100 


59% 

0.01 

77 

0.01 

82 

0.02 

89 

NS 

NA 

- 

100 

NS 
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Ratings 

Manufacturers  do  not  consider  the  image  quality  of  competitors' 
products  to  be  the  same.   The  null  hypothesis  that  the  equipment  is 
believed  to  perform  equally  well  can  be  rejected  at  the  -c^   =  0.05  level  in 
each  case  (Table  VIII>. 

■  In  showing  a  difference  among  the  products,  the  Kruskal-Wallis  test 
also  shows  consistency  among  the  raters  because  the  rankings  need  to  be 
consistent  for  the  average  of  each  product's  rankings  to  be  different. 
The  stronger  the  differences  in  averages,  the  greater  the  consonance 
among  the  raters. 

The  result  for  hospital  respondents  was  quite  another  story.   In 
addition  to  having  very  little  awareness  of  the  existing  products,  users 
saw  very  little  difference  in  image  quality  for  the  products  that  they 
did  know.   In  two  of  the  three  modalities,  the  null  hypothesis  that  all 
the  products  were  ranked  identically  could  not  be  rejected  (Table  IX), 

In  addition  to  testing  the  45  users  as  a  group,  various  subgroups  of 
respondents  were  tested  for  consonance  in  rankings.   The  subgroups  chosen 
were  the  same  as  those  listed  in  Table  II,  with  some  additional  testing 
of  those  people  who  had  higher  levels  of  awareness  in  each  product 
group.   This  separation  of  respondents  into  subgroups  acts  as  a  check  for 
consistency  in  rankings  within  subgroups  but  inconsistency  among 
subgroups  that  could  have  eliminated  total  group  consistency  for  phased 
arrays  and  3-scans. 

The  phased  array-radiology  product  segment  is  the  newest  segment  but 
has  the  least  number  of  products-three.   Even  with  so  few  products,  the 
users  as  a  group  and  users  in  the  several  subgroups  could  not  differen- 
tiate among  the  three  products  in  terms  of  image  quality  (Table  X). 
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Table  VIII 


Manufacturers'  Belief  that  Image  Quality  is  Identical 
(Kruskal-Wallis  One-Way  Analysis  of  Variance  by  Ranks) 


Type  of  Equipment 


Phased  Array-Cardiology 
Phased  Array-Radiology 
Mechanical  Sector-Radiology 
Mechanical  Sector-Cardiology 
Linear  Array-Obstetrics 
B-scan-Radiology 


14.36 

0.02 

13.68 

0.01 

45.60 

0.001 

19.69 

0.02 

47.85 

0.001 

19.13 

0.01 

Table  IX 


Users  Belief  that  Image  Quality  is  Identical 
(Kruskal-Wallis  One-Way  Analysis  of  Variance  by  Ranks) 


Type  of  Equipment 


Phased  Array-Radiology 
B-Scan-Radiology 
Mechanical  Sector-Radiology 


0.95 

NS 

10.96 

NS 

70.92 

0.001 
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Table  X 


Users'  Belief  that  Image  Quality  is  Identical 
(Kruskal-Wallis  One-Way  Analysis  of  Variance  by  Ranks) 


Subgroups 


Phased  Array 


B-Scan 


Mechanical  Sector 


All  Respondents 
Radiologists 
Sonographers 
Hospitals  making 

purchase  in  last 

year 
Hospitals  making 

earlier  or  no 

purchase 
New  England  hospitals 
Other  regions 
Large  hospitals 
Medium  hospitals 
Small  hospitals 
Those  with  a  large 

number  of  responses 
Those  who  own  the 

equipment  type 
Those  who  own  the 

equipment  type  and 

are  actively  buying 

more  equipment 


0.95 

NS 

10.96 

NS 

70.92 

0.001 

2.71 

NS 

11.41 

NS 

39.57 

0.001 

0.03 

NS 

8.31 

NS 

32.19 

0.001 

0.71 


NS 


9.22 


NS 


57.46  0.001 


1.11 

NS 

7.42 

NS 

19.76 

0.02 

1.19 

NS 

3.53 

NS 

47.71 

0.001 

3.69 

NS 

7.42 

NS 

30.59 

0.001 

0.21 

NS 

2.59 

NS 

19.67 

0.02 

1.97 

NS 

13.75 

0.05 

29.22 

0.001 

0.23 

NS 

5.97 

NS 

36.99 

0.001 

1.40 

NS 

4.45 
10.96 

NS 
NS 

3.39 


NS 
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The  B-scan  product  segment  had  results  similar  to  the  phased  array 
segment  -  the  respondents  could  not  differentiate  among  products  in  terms 
of  image  quality.   Because  this  segment  is  the  oldest  market  segment  of 
the  three  and  because  it  contains  seven  products,  more  subgroups  were 
analyzed  to  discover  if  users  could  differentiate  among  products.   In 
addition  to  the  subgroups  as  before,  present  owners  of  B-scans, 
respondents  who  rated  at  least  three  products,  and  owners  in  search  of 
new  equipment  were  added. 

Only  the  respondents  from  the  medium-sized  hospitals  could 
differentiate  image  quality  among  the  B-scan  products.   Upon  further 
analysis,  the  researcher  found  that  the  technicians  in  medium-sized 
hospitals,  and  not  the  radiologists,  could  differentiate  among  products. 
This  result  cannot  be  explained  and  may  just  be  due  to  noise. 
Sonographers  in  general  could  not  distinguish  image  quality  in  the 
various  products  so  why  those  in  medium-sized  hospitals  can  is  unclear. 
The  product  rankings  the  respondents  in  this  subgroup  gave,  however,  were 
identical  to  the  rankings  the  manufacturers  gave. 

The  reason  the  hospital  respondents  as  a  group  could  not  distinguish 
image  quality  in  the  various  products  was  not  because  each  subgroup  of 
rankers  had  different  criteria.   None  of  the  tested  subgroups,  with  one 
exception,  had  significant  difference  scores.   The  hospital  respondents, 
therefore,  could  not  distinguish  image  quality  in  the  phased  array  and 
B-scan  products. 

In  the  one  product  segment,  mechanical  sector,  that  the  users  could 
distinguish  image  quality,  the  same  analysis  of  the  various  subgroups  was 
performed  to  test  which  subgroups  had  significant  difference  scores  in 
ranking  image  quality.   Spearman  rank  correlation  analysis  was  then 
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performed  on  the  rankings  determined  within  each  subgroup  and  its 
complement  to  test  for  consistency  among  the  subgroups.   Respondents 
within  each  subgroup  were  able  to  differentiate  image  quality  (Table  X). 
Dividing  the  respondents  into  subgroups  along  the  several  dimensions, 
moreover,  had  very  little  effect  on  the  rankings  given  (Table  XI). 

Listed  in  Table  XI  is  an  additional  result  that  is  quite 
interesting.   Manufacturers  and  users  have  little  agreement  in  the  way 
they  rank  equipment  in  terms  of  image  quality.   The  Spearman  Rank 
Correlation  Coefficient  equaled  0.35,  which  is  not  significant  at  an  ^  = 
0.05  level. 

The  hospital  radiology  departments,  in  summary,  had  little  awareness 
of  the  image  quality  of  the  diagnostic  ultrasound  equipment  in  general 
use  in  their  practices.   Of  the  equipment  the  respondents  did  know,  only 
mechanical  sectors  could  be  differentiated  but  in  a  manner  totally 
different  from  the  technical  experts  at  the  manufacturing  concerns. 

Intra-group  differences  among  the  users  were  surprisingly  small. 
Sonographers  had  more  knowledge  of  equipment,  but  none  of  the  users  in 
the  various  subgroups  could  differentiate  image  quality  in  all  the 
modalities.   In  the  one  modality  where  image  quality  was  distinguished, 
the  subgroups  and  their  complements  had  high  agreement  in  their  rankings. 
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Table  XI 


Degree  to  Which  Subgroups  Agree  in  Tneir  Rankings  of  Image 

Quality  for  Mechanical  Sector  Products 

(Spearman  Rank  Correlation) 


Subgroups 


Radiologists-Sonographers 

Recent  purchasers-Earlier  purchasers 

New  England  Hospitals-Other  Regions 

Large  Hospitals-Medium  Hospitals-Small  Hospitals 

Manufacturers -Users 


0.98 

0.01 

0.62 

0.05 

0.78 

0.01 

0.82 

0.01 

0.35 

NS 
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VIII.   Discussion 

The  survey  of  technical  experts  from  manufacturing  concerns  has  shown 
that  these  raters  have  relatively  complete  knowledge  of  the  variety  of 
competitors'  products  available  and  consider  these  to  be  different  from 
each  other  in  performance.   By  using  these  experts,  therefore,  a 
researcher  can  create  rankings  of  image  quality,  which  can  substitute  for 
some  objective  rankings. 

Results  from  the  hospital  survey,  however,  raise  some  interesting 
questions.   Can  a  firm  really  have  a  competitive  advantage  with  better 
technology  if  the  consumer  cannot  differentiate  quality  of  technology? 
How  good  are  the  product  comparisons,  moreover,  if  the  consumers  know  so 
little  about  the  existing  products? 

One  would  have  to  doubt  the  existence  of  any  real  screening  by 
present  purchasers  of  products  if  they  are  aware  only  of  a  few  pieces  of 
equipment.   Recent  purchasers,  in  an  industry  where  product  lives  are 
very  short,  are  not  aware  of  more  equipment  and  do  not  rate  equipment 
differently  than  consumers  who  purchased  equipment  more  than  a  year 
before.   New  information  may  not  be  diffusing  effectively  to  customers. 

Frost  and  Sullivan  (1982)  claim  that  ultrasound  manufacturers,  unlike 
other  medical  equipment  makers,  are  leading  the  users  in  creating  new 
technologies  and  new  applications.   If  this  is  so  and  the  users  are  slow 
in  evaluating  the  new  technologies,  one  can  understand  the  consumers' 
inability  to  differentiate  products.   The  B-scan  modality,  however,  would 
be  the  most  likely  to  be  differentiated  because  it  is  the  oldest  and  the 
slowest  changing  modality.   Consumers'  knowledge  should  have  caught  up  to 
that  of  the  manufacturers,  if  it  were  going  to,  in  this  modality. 
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Another  explanation  of  the  inability  of  users  to  distinguish 
performance  among  products  might  lie  in  the  fact  that  image  quality  is 
user  specific.   An  interdependence  might  exist  between  user 
characteristics  and  equipment  characteristics  that  prevents  consistent 
differentiation.   That  is,  some  products  may  function  better  for  certain 
users  and  other  products  for  other  users.   The  mechanical  sector 
modality,  however,  has  the  largest  number  of  uses  and  users,  so  one  could 
argue  that  it  should  be  least  easily  differentiated  if  the  above  were 
true.   In  fact,  this  is  the  only  modality  in  which  users  significantly 
differentiate  among  products. 

A  third  hypothesis  to  explain  the  hospital  survey  results  is  that 
B-scan,  the  oldest  modality  which  may  now  be  a  mature  product,  has  images 
that  are  really  the  same  among  products;  phased  array,  the  newest 
modality,  is  too  new  to  be  distinguished  yet;  and  mechanical  sector,  the 
only  differentiated  modality,  is  both  old  enough  to  be  distinguished  and 
has  true  differences  in  product.   The  paradox  would  remain,  then,  as  to 
why  the  manufacturers'  technical  experts  make  the  distinctions  they  do. 

The  problem  of  why  the  users  are  so  different  in  rating  image  quality 
from  the  manufacturers  may  lie  in  the  survey  method.   If  asked  directly, 
consumers  cannot  differentiate  all  the  products,  but  they  may  still  do  so 
implicitly  in  their  buying  patterns.   A  multivariate  analysis  of  the 
importance  of  image  quality  to  market  share  would  be  needed  to  show  this. 

Such  a  study  would  also  answer  the  question  of  the  importance  of 
image  quality  to  market  success.   The  importance  of  image  quality  was 
discussed  in  Section  IV.   In  this  survey,  also,  80  percent  of  the 
respondents  who  gave  criteria  for  selecting  equipment  ranked  image 
quality  first.   One  would  have  to  question,  however,  the  importance  of 
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image  quality  if  consumers  cannot  differentiate  along  that  dimension,  do 
not  perceive  it  as  really  different  or  do  not  even  really  try  to 
distinguish  it. 

Asking  radiologists  who  are  trying  to  remain  current  with  the  changes 
in  all  the  other  imaging  techniques  to  be  aware  of  the  changes  in 
ultrasound  technology  may  be  expecting  too  much.   If  researchers  have  not 
been  able  to  devise  a  method  for   rating  functional  utility  in 
ultrasound  products,  and  they  have  tried,  individual  radiologists  cannot 
be  expected  to  do  so  when  performing  product  comparisons.   The  users' 
inability  to  distinguish  image  quality  raises  several   questions  on  the 
validity  of  the  product  information  search.   If  people  who  are  presently 
comparing  products  gain  no  more  information  than  those  who  have  not  done 
so  for  a  year,  do  the  comparisons  help  in  the  decision  process?   If 
buyers,  moreover,  do  not  actually  test  that  many  products,  can  they 
really  make  valid  comparisons?   Do  the  other  doctors  who  provide 
recommendations  from  experience  really  know  anything  if  the  products 
change  so  quickly? 

If  it  takes  time  and  experience  to  differentiate  image  quality,  and 
yet  the  technology  is  changing  so  quickly  that  experienced  users  cannot 
help  on  choosing  the  new  equipment,  consumers  may  not  be'  trying  to  judge 
image  quality  at  all.   Consumers  may  instead  consider  the  image  quality 
of  a  modality.   Once  the  modality  is  of  a  quality  to  provide  diagnostic 
utility,  individual  differences  may  be  unimportant.   Consumers  may  be 
judging  product  on  non-technology  dimensions  and  so  are  not  in 
concordance  with  the  manufacturers  in  ranking  equipment. 

If  this  is  so,  is  technological  competition  real  in  the  market  place 
as  expounded  by  so  many  analysts  of  the  industry,  or  is  it  only  perceived 
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to  be  so  by  the  manufacturing  organizations  and  not  the  users?   The 
marketing  and  diffusion  literatures  stated  that  perceived  advantage  is 
related  to  greater  success.   Technological  competition  among  the 
manufacturers  has  been  directed  at  improving  image  quality,  yet  the 
purchasers  of  ultrasound  equipment  do  not  perceive  any  difference  in  that 
image  quality.   If  there  is  no  perception  of  advantage,  the  technological 
competition  among  the  manufacturers  may  not  be  providing  any  competitive 
advantage  at  all. 

If  users  are  not  really  trying  to  distinguish  products  by  image 
quality  nor  really  capable  of  doing  so,  the  question  still  remains  of 
what  is  driving  the  competition  that  is  causing  the  industry  to  become 
more  and  more  fragmented.   A  further  study  using  the  quality  ratings  with 
such  factors  as  sales  intensity,  service  capability,  and  Fusfeld's 
dimensions  may  answer  the  question.   This  technology-driven  industry  may 
not  be  technology-driven  after  all. 
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APPENDIX 


\\as5achusetts  Institute  ot  Technology 

Sloan  School  or  Management 

50  viemorial  Drive 

Cambridge,  Massachusetts.  02139 


Dear  Physician : 

I  am  a  graduate  student  at  the  Massachusetts  Institute  of 
Technology  and  am  studying  the  relationship  between  quality  of  technology 
and  success  in  the  marketplace.   One  industry  I  am  analyzing  is  medical 
diagnostic  ultrasound  equipment. 

I  have  defined  quality  of  technology  for  diagnostic  equipment  to 
mean  that  equipment  which  can  give  the  most  diagnostic  information.   I 
need  some  ranking,  then,  of  the  equipment  as  to  its  functional 
performance,  i.e.,  its  image  quality.   I  will  control  for  acquisition 
cost,  ease-of-use,  operating  cost,  reliability,  serviceability,  and 
compatibility. 

I  know  that  different  formats,  e.g.,  mechanical  sector  and  phased 
array,  have  differing  capabilities  dependent  on  the  application.   I  have 
divided,  therefore,  the  survey  into  sections  by  the  scanner  type  and  the 
general  application. 

I  am  surveying  both  ultrasonographers  and  manufacturers  and  am 
asking  them  to  rank  equipment.   I  will  average  the  ratings  and  use  rank 
order  analyses  to  create  a  ranking  of  image  quality.   The  results  of  this 
survey  will  be  used  for  academic  purposes  only,  and  your  actual  rankings 
will  be  kept  strictly  confidential.   I  would  appreciate  your  taking  ten 
minutes  to  fill  out  the  survey. 

If  you  would  be  interested  in  the  results  of  the  stuc;.  ,  write  your 
name  and  address  on  the  back  of  the  survey  and  I  will  send  you  a  copy  of 
the  paper, 

Sinerely, 


John  Friar 
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INSTRUCTIONS 

This  survey  is  straightf on^/ard  and  should  take  no  nore  than  ten 
minutes  to  finish.   I  ara  asking  you  to  rate  the  image  quality  of  various 
manufacturers'  ultrasound  equipment.   For  each  manufacturer,  consider  the 
top-of-the-line  products  which  have  been  on  the  market  for  at  least  one 
year.   Do  not  consider  any  recently  announced  products. 

The  rating  goes  from  a  low  of  one  (1)  to  a  high  of  ten  (10);  a  ten 
would  be  the  best  possible  image.  Rating  steps  may  be  fractional,  e.g., 
6.75,  and  please  try  to  avoid  tie  scores. 

I  also  ask  for  the  basis  of  your  rating,  which  you  should  just 
check.   The  bases  are: 

Used  in-house:   you  have  used  the  equipment  in  your  practice  or 

training . 
Tested:         you  have  used  the  equipment  but  only  for  a 

short-time  to  test  or  examine  the  equipment. 
Demo:  you  watched  someone  else  use  the  equipment. 

Reputation:     you  have  not  used  or  seen  the  equipment. 

A  rating  of  zero  (0)  would  mean  that  you  have  never  heard  of  the 
product . 

The  survey  is  sectioned  by  product  type,  and  the  companies  are 
listed  alphabetically. 

Please  return  completed  questionnaires  to  the  marked  boxes. 

Thank  you  for  your  cooperation. 
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1.      Position  and  departinent  of  responder: 


Location  of  Practise 


2a.     If  hospital  based,  size  and  .type  of  hospital  (e.g.,  400 
bed-community)  : 


3.      Percentage  use  of  equipment  in  this  department  for  following 
areas  : 

General  Abdominal  

Cardiology        

OB/GYN  

Neonate  

Surgery  


100% 


4.      Present  equipment  in  this  department: 


Approximate  purchase  dates  of  equipment  and  length  of  decision 
process  : 


6.      Future  purchase  plans  (Equipment,  date,  decision  procedure) 


7,      How  do  you  keep  up  with  all  the  changes  in  product 


8.      How  would  vou  decide  between  various  manufacturers'  equipment? 


-4- 


Mechanical  Sector  -  Abdomen 


Company  Rating     Experience  {  y") 

( 0-10)     Used  in-house     Tested     Demo       Reputation 


ADR 

ATI 

Ausonics 

CGR 

Diasonics 

Ekoline 

Elscint 

Fischer 

GE 

Hitachi 

Philips 

Picker 

Technicare 

Toshiba 


Mechanical  Sector  -  OB/GYN 


ADR/ATL 

Aloka /Technicare 

Diasonics 

Ekoline 

Elscint 

Philips 

Picker 

Toshiba 


ADR 
ATL 

Diasonics 
Ekoline 
Elscint 
Hoffrel 
Honeywell/ 
E   for  M 

Irex 

Philips 

Picker 

Second 

Foundation 

Technicare 

Toshiba 
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Mechanical  Sector  -  Cardiac 


Company  Rating     Experience  ( ■/) 

(0-10)     Used  in-house     Tested     Demo       Reputation 
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Phased  Array  -  Cardiac 


Company  Rating  Experience  (  ■,/) 

(0-10)  Used  in-house  Tested  Demo  Reputation 

Diasonics        

Fischer  

GE            ^^^^^                    ^^3ZZ  ZZZH 

HP  

Irex  

Philips  

Toshiba 


Acuson 

GE 

Hewlett  Packard 


Phased  Arrav  -  Abdominal 
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Linear  Array 


^22ESni  10m  uSlr-rouse^   Tested     De»o       Reputation 


Acuson 

ADR/ATL 

Aloka/Technicare 

Bion 

CGR 

Elscint 

Ekoline 

Fischer 

GE 
Hitachi/Diasonics 

Hitachi/Picker 
Kontron 

National/Pi  Data 
Organon 

Teknika 
Siemens 
Toshiba 
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B-Scans 


Company  Rating      Experience  (  •/ ) 


(0-10)      Used  in-house    Tested     Demo       Reputatioi 


CGR 

GE 

Philips 

Picker 

Siemens 

Sonometrics 

Technicare 

Toshiba 

Xonics/Ekoline 


Thank  you  for  your  help. 

Please  return  completed  survey  to  marked  boxes, 


Name  and  address  for  survev  results: 


3780    UI9 


3    TDfiD    ODM    Mfli    ai5 


Date  Due 


BASEMtm 


m 


c^m 


•  -,* 

2  "■^•''5 
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